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[Abstract] 
[Object] 

It is an object of the present invention to provide 
a single-plate color image pickup apparatus which can obtain 
an image signal having a high resolution both in the 
horizontal and vertical directions, and which has a high 
speed reading mode. 
[Means for Achieving the Object] 

In a single-plate color image pickup apparatus for 
generating a color image signal from an incident light on 
an image pickup element through a color filter array of four 
colors, the color filter array has a periodicity of two rows 
x two columns, and colors of four color filters in a 
periodical unit of two rows x two columns are all different 
from each other. Also, color difference signals of two 
types are read from two rows x two columns, respective two 
color difference signals of two types are read from four 
rows x four columns, and luminance signals are read from 
two rows x four columns or four rows x two columns. 
[Elected Drawing] 

Figure 1 
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[Name of the Document] Specification 

[Title of the Invention] Color Image Pickup 

Apparatus And Image Signal 

Read Method 

[What is Claimed is] 
[Claim 1] 

A color image pickup apparatus for generating a 
color image signal from an incident light on an image pickup 
element through a color filter array of four colors, 
characterized in that : 

said color filter array has a periodicity of two 
rows x two columns, and colors of four color filters in a 
periodical unit of two rows x two columns are all different 
from each other. 

[Claim 2] 

A color image pickup apparatus according to claim 
1, wherein the four color filters include a filter of 
transmitting only green light in a visible light range, a 
filter of intercepting only blue color in the visible light 
range, a filter of intercepting only green light in the 
visible light range, and a filter of intercepting only red 
light in the visible light range. 

[Claim 3] 

A color image pickup apparatus according to claim 
1 or 2, further comprising means for performing an operation 
of A + B - C - D, where A, B, C, and D represent signals 
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picked up from an area of two rows x two columns. 
[Claim 4] 

A color image pickup apparatus according to claim 
3, wherein the signals A and B are disposed on a same line 
or on a same column, and the signals C and D are disposed 
on a same line or on a same column. 

[Claim 5] 

A color image pickup apparatus according to claim 
3, further comprising means for performing an operation of 
A + C - B - D. 

[Claim 6] 

A color image pickup apparatus according to claim 
3, wherein the signals A and B are disposed on a same line 
or on a same column, and the signals C and D are disposed 
on a same line or on a same column. 

[Claim 7] 

A color image pickup apparatus according to claim 
1 or 2, further comprising means for reading a difference 
between an addition signal of a first row, first column 
signal and a first row, second column signal and an addition 
signal of a second row, first column signal and a second 
row, second column signal, respectively in an area of two 
rows x two columns column, and means for reading a difference 
between an addition signal of a first row, first column 
signal and a second row, first column signal and an addition 
signal of a first row, second column signal and a second 
row, second column signal, respectively in the area of two 
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rows x two columns column. 
[Claim 8] 

A color image pickup apparatus according to claim 
7, wherein the areas of two rows x two columns are disposed 
without any space therebetween. 

[Claim 9] 

A color image pickup apparatus according to claim 
1 or 2, further comprising means for reading an addition 
signal of all signals in an area of four rows x one column. 

[Claim 10] 

A color image pickup apparatus according to claim 
1 or 2, further comprising means for reading an addition 
signal of all signals in an area of one row x four columns. 
[Claim 11] 

An image signal read method of reading an image 
signal from the image pickup apparatus recited in claim 1, 
wherein an image signal is read by performing an operation 
of A + B - C - D, where A, B, C, and D represent signals 
picked up from an area of two rows x two columns. 

[Claim 12] 

An image signal read method according' to claim 11 , 
wherein the signals A and B are disposed on a same line or 
on a same .column, and the signals C and D are disposed on 
a same line or on a same column. 

[Claim 13] 

An image signal read method according to claim 11, 
wherein an image signal is read by performing an operation 
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of A + C - B - D. 

[Claim 14] 

An image signal read method according to claim 13, 
wherein the signals A and B are disposed on a same line or 
on a same column, and the signals C and D are disposed on 
a same line or on a same column. 

[Claim 15] 

An image signal read method of reading an image 
signal from the color image pickup apparatus recited in 
claim 1 or 2, wherein a difference between an addition signal 
of a first row, first column signal and a first row, second 
column signal and an addition signal of a second row, first 
column signal and a second row, second column signal, 
respectively in an area of two rows x two columns column, 
is read as a first color difference signal, and a difference 
between an addition signal of a first row, first column 
signal and a second row, first column signal and an addition 
signal of a first row, second column signal and a second 
row, second column signal, respectively in the area of two 
rows x two columns column, is read as a second color 
difference signal . 

[Claim 16] 

An image signal read method according to claim 15, 
wherein the areas of two rows x two columns are disposed 
without any space therebetween. 

[Claim 17] 

An image signal read method of reading an image 
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signal from the color image pickup apparatus recited in 
claim 1 or 2, wherein an addition signal of all signals in 
an area of four rows x two columns is read as a luminance 
signal . 

[Claim 18] 

An image signal read method of reading an image 
signal from the color image pickup apparatus recited in 
claim 1 or 2, wherein an addition signal of all signals in 
an area of two rows x four columns is read as a luminance 
signal . 

[Claim 19] 

A color image pickup apparatus for generating a 
color image signal from an incident light on an image pickup 
element through a color filter array of four colors, 
comprising: 

first calculating means for calculating a 
difference between an average signal of a first row, first 
column signal and a first row, second column signal in an 
area of two rows x two columns and an average signal of a 
second row, first column signal and a second row, second 
column signal in the area of two rows x two columns; and 

second calculating means for calculating a 
difference between an average signal of a first row, first 
column signal and a second row, first column signal in the 
area of two rows x two columns and an average signal of a 
first row, second column signal and a second row, second 
column signal in the area of two rows x two columns. 
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[Claim 20] 

A color image pickup apparatus according to claim 
21, wherein: 

said first calculating means comprises first 
storing means for storing the first row, first column 
signal, second storing means for storing the first row, 
second column signal, third storing means for storing the 
second row, first column signal, fourth storing means for 
storing the second row, second column signal, first 
averaging means for averaging the signals stored in said 
first and second storage means, second averaging means for 
averaging the signals stored in said third and fourth 
storage means, and first difference calculating means for 
calculating a difference between an averaged signal of the 
signals stored in said first and second storage means and 
an averaged signal of the signals stored in said third and 
fourth storage means; and 

said second calculating means comprises fifth 
storing means for storing the first row, first column 
signal, sixth storing means for storing the second row, 
first column signal, seventh storing means for storing the 
first row, second column signal, eighth storing means for 
storing the second row, second column signal, third 
averaging means for averaging the signals stored in said 
third and fourth storage means, fourth averaging means for 
averaging the signals stored in said fifth and sixth storage 
means , and second difference calculating means for 
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calculating a difference between an averaged signal of the 
signals stored in said fifth and sixth storage means and 
an averaged signal of the signals stored in said seventh 
and eighth storage means. 
[Claim 21] 

A processing apparatus for the color image pickup 
apparatus recited in claim 1 or 2, comprising means for 
performing an operation of A + B - C - D, where A, B, C, 
and D represent signals picked up from an area of two rows 
x two columns . 

[Claim 22] 

A processing apparatus according to claim 21, 
wherein the signals A and B are disposed on a same line or 
on a same column, and the signals C and D are disposed on 
a same line or on a same column. 

[Claim 23] 

A processing apparatus according to claim 21, 
further comprising means for performing an operation of A 
+ C - B - D. 

[Claim 24] 

A processing apparatus according to claim 23, 
wherein the signals A and B are disposed on a same line or 
on a same column, and the signals C and D are disposed on 
a same line or on a same column. 

[Claim 25] 

A processing method for the color image pickup 
apparatus recited in claim 1 or 2, comprising a step of 
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performing an operation of A + B - C - D, where A, B, C, 
and D represent signals picked up from an area of two rows 
x two columns . 

[Claim 26] 

A processing method according to claim 25, wherein 
the signals A and B are disposed on a same line or on a same 
column, and the signals C and D are disposed on a same line 
or on a same column. 

[Claim 27] 

A processing method according to claim 25, 
comprising a step of performing an operation of A + C - B 
- D. 

[Claim 28] 

A processing method according to claim 27, wherein 
the signals A and B are disposed on a same line or on a same 
column, and the signals C and D are disposed on a same line 
or on a same column. 

[Claim 29] 

A computer readable storage medium storing a 
program for the color image pickup apparatus recited in 
claim 1 or 2, wherein the program performs an operation of 
A + B - C - D, where A, B, C, and D represent signals picked 
up from an area of two rows x two columns. 

[Claim 30] 

A computer readable storage medium according to 
claim 29, wherein the signals A and B are disposed on a same 
line or on a same column, and the signals C and D are disposed 
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on a same line or on a same column. 
[Claim 31] 

A computer readable storage medium according to 
claim 29, wherein the program further includes a program 
of performing an operation of A + C - B - D. 

[Claim 32] 

A computer readable storage medium according to 
claim 31, wherein the signals A and B are disposed on a same 
line or on a same column, and the signals C and D are disposed 
on a same line or on a same column. 

[Claim 33] 

An image pickup system comprising the color image 
pickup apparatus recited in claim 1 and the processing 
apparatus recited in any one of claims 21 to 24. 

[Claim 34] 

An image pickup system comprising the color image 
pickup apparatus recited in claim 2 and the processing 
apparatus recited in any one of claims 21 to 24, 
[Detailed Description of the Invention] 
[0001] 

[Field of the Industrial Utilization] 

The present invention relates to a color image 
pickup apparatus for generating a color image signal from 
light incident on an image pickup element from a color filter 
array, to an image signal read method of reading an image 
signal from the color image pickup apparatus. 
[0002] 
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[Prior Art] 

In order to obtain a color image signal in a color 
image pickup apparatus, light is incident upon image pickup 
elements via a color filter. The color filter includes a 
primary color filter and a complementary color filter. The 
primary color filter has three colors, red, green, and blue, 
whereas the complementary color filter has four colors, cyan, 
yellow, magenta, and green. A cyan color filter intercepts 
only red color in the visible light range, an yellow color 
filter intercepts only blue color in the visible light range, 
a magenta color filter intercepts only green color in the 
visible light range, and a green color filter transmits only 
green light. 
[0003] 

In the case of complementary color filters, a 
luminance signal Y is given by: 

Y = Ye + G + Cy + Mg ... (1), 

a blue color difference signal is given by: 

CB = (G + Ye) - (Mg + Cy) ... (2), 

and a red color difference signal is given by: 

CR = (Cy + G) - (Ye + Mg) ... (3) 

wherein Cy is a signal picked up by image pickup elements 
via cyan color filters, Ye is a signal picked up by image 
pickup elements via the yellow color filters, Mg is a signal 
picked up by image pickup elements via magenta color filters, 
and G is a signal picked up by image pickup elements via 
green color filters. 



- 11 - 



[0004] 

Fig. 10 shows a pattern of color filters according 
to a first conventional example. This pattern has a 
periodicity of two pixels in the horizontal direction and 
four pixels in the vertical direction. With this color 
filter pattern, the luminance signal Y can be obtained 
through the equation (1) by using Cy, Ye, Mg, and G in a 
block of 2x2 pixels, two pixels in the horizontal direction 
and two pixels in the vertical direction. Similarly the 
blue and red color difference signals CB and CR can be 
obtained through the equations (2) and (3) by using Cy, Ye, 
Mg, and G in the block of 2 x 2 pixels. 
[0005] 

Fig. 11 shows a pattern of color filters according 
to a second conventional example. This pattern has a 
periodicity of two pixels in the horizontal direction and 
four pixels in the vertical direction. With this color 
filter pattern, the luminance signal Y can be obtained 
through the equation (1) by using Cy, Ye, Mg, and G in a 
block of 2x2 pixels, two pixels in the horizontal direction 
and two pixels in the vertical direction. Similarly the 
blue and red color difference signals CB and CR can be 
obtained through the equations (2) and (3) by using Cy, Ye, 
Mg, and G in the block of 2 x 2 pixels. 
[0006] 

[Problems to be Solved by the Invention] 

A digital still camera with an image pickup 
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apparatus reads an image at high speed with a sacrifice of 
resolution before an image is photographed. In accordance 
with the image signal read at high speed, an image is 
displayed in a finer such as a liquid crystal finder, an 
iris is adjusted, a white balance is adjusted, or other 
preliminary operations are performed. However, with a 
combination of the color filter layout shown in Fig. 1 and 
a conventional image pickup apparatus CCD, even if the pixel 
signal is read at high speed with a sacrifice of resolution 
by thinning every second pixel in the vertical direction, 
for example, only cyan and yellow signals are obtained so 
that the while balance cannot be adjusted in accordance with 
outputs of the image pickup elements. 
[0007] 

Also with the combination of the color filter layout 
shown in Fig. 10 and a conventional image pickup apparatus 
CCD, data of two adjacent pixels in the vertical direction 
is added and thereafter transferred in the image pickup 
apparatus and output therefrom. Therefore, paired image 
data is output from the image pickup apparatus. More 
specifically, referring to Fig. 10, a pair of data of pixels 
(CI, Rl) and (CI, R2) is output, then a pair of data of pixels 
(C2, Rl) and (C2, R2) is output, then pairs of data of column 
pixels in the rows Rl and R2 are sequentially output. Next, 
a pair of data of pixels (CI, R3) and (CI, R4) is output, 
then a pair of data of pixels (C2, R3) and (C2, R4 ) is output, 
then pairs of data of column pixels in the rows R3 and R3 
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are sequentially output- Since these outputs are used, the 
calculation of the equation (2) can be made, for example, 
for the rows Rl and R2, but it cannot be made for the rows 
R3 and R4 . Similarly, the calculation of the equation (3) 
can be made, for example, for the rows R3 and R4, but it 
cannot be made for the rows Rl and R2 . Therefore, the color 
difference signal for each color can be obtained only from 
one row among the four rows of image pickup elements so that 
the resolution of the color difference signal lowers in the 
vertical direction . 
[0008] 

With the combination of the color filter layout 
shown in Fig. 11 and a conventional image pickup apparatus 
CCD, a signal read in a high speed read mode can be used 
for adjusting the white balance . 
[0009] 

With the combination of the color filter layout 
shown in Fig. 11 and a conventional image pickup apparatus 
CCD, data of two adjacent pixels in the vertical direction 
is added and thereafter transferred in the image pickup 
apparatus and output therefrom. Therefore, paired image 
data is output from the image pickup apparatus. More 
specifically, referring to Fig. 11, a pair of data of pixels 
(CI, Rl) and (CI, R2) is output, then a pair of data of pixels 
(C2, Rl) and (C2, R2) is output, then pairs of data of column 
pixels in the rows Rl and R2 are sequentially output. Next, 
a pair of data of pixels (CI, R3) and (CI, R4) is output, 
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then a pair of data of pixels (C2, R3) and (C2, R4 ) is output, 
then pairs of data of column pixels in the rows R3 and R3 
are sequentially output. Since these outputs are used, the 
calculation of the equation (2) can be made, for example, 
for the rows Rl, R2, R3, and R4, but it cannot be made for 
the rows R5, R6, R7, and R8 . Similarly, the calculation of 
the equation (3) can be made, for example, for the rows R5, 
R6, R7, and R8, but it cannot be made for the rows Rl, R2, 
R3, and R4 . Therefore, the color difference signal for each 
color can be obtained only from two rows among the eight 
rows of image pickup elements so that the resolution of the 
color difference signal lowers in the vertical direction. 
[0010] 

It is an object of the present invention to provide 
a color image pickup apparatus which can obtain an image 
signal having a high resolution both in the horizontal and 
vertical directions . 
[0011] 

It is another object of the present invention to 
provide a color image pickup apparatus which is provided 
with a multi-mode such as a mode of outputting an image signal 
at high speed which signal can be used for simple color 
display, autofocus, white balance adjustment and a mode of 
outputting an image signal having a high resolution. 
[0012] 

[Means for Solving the Problems] 

According to the present invention, there is 
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provided a color image pickup apparatus for generating a 
color image signal from an incident light on an image pickup 
element through a color filter array of four colors, 
characterized in that: the color filter array has a 
periodicity of two rows x two columns, and colors of four 
color filters in a periodical unit of two rows x two columns 
are all different from each other, 
[0013] 

The color image pickup apparatus of the present 
invention is characterized in that the four color filters 
include a filter of transmitting only green light in a 
visible light range, a filter of intercepting only blue 
color in the visible light range, a filter of intercepting 
only green light in the visible light range, and a filter 
of intercepting only red light in the visible light range. 
[0014] 

Further, the color image pickup apparatus of the 
present invention is characterized by further comprising 
means for performing an operation of A + B - C - D, where 
A, B, C, and D represent signals picked up from an area of 
two rows x two columns - 
[0015] 

Further, the color image pickup apparatus of the 
present invention is characterized in that the signals A 
and B are disposed on a same line or on a same column, and 
the signals C and D are disposed on a same line or on a same 
column . 
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[0016] 

Further, the color image pickup apparatus of the 
present invention is characterized by further comprising 
means for performing an operation of A + C - B - D. 
[0017] 

Further, the color image pickup apparatus of the 
present invention is characterized in that the signals A 
and B are disposed on a same line or on a same column, and 
the signals C and D are disposed on a same line or on a same 
column. 
[0018] 

Further, the color image pickup apparatus of the 
present invention is characterized by further comprising 
means for reading a difference between an addition signal 
of a first row, first column signal and a first row, second 
column signal and an addition signal of a second row, first 
column signal and a second row, second column signal, 
respectively in an area of two rows x two columns column, 
and means for reading a difference between an addition 
signal of a first row, first column signal and a second row, 
first column signal and an addition signal of a first row, 
second column signal and a second row, second column signal, 
respectively in the area of two rows x two columns column. 
[0019] 

Further, the color image pickup apparatus of the 
present invention is characterized in that the areas of two 
rows x two columns are disposed without any space 
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therebetween . 
[0020] 

Further, the color image pickup apparatus of the 
present invention is characterized by further comprising 
means for reading an addition signal of all signals in an 
area of four rows x one column. 
[0021] 

Further, the color image pickup apparatus of the 
present invention is characterized by further comprising 
means for reading an addition signal of all signals in an 
area of one row x four columns. 
[0022] 

According to the present invention, there is 
provided an image signal read method of reading an image 
signal from the image pickup apparatus recited above, 
wherein an image signal is read by performing an operation 
of A + B - C - D, where A, B, C, and D represent signals 
picked up from an area of two rows x two columns. 
[0023] 

Further, the image signal read method according to 
the present invention is characterized in that the signals 
A and B are disposed on a same line or on a same column, 
and the signals C and D are disposed on a same line or on 
a same column. 
[0024] 

Further, the image signal read method according to 
the present invention is characterized in that an image 



- 18 - 



signal is read by performing an operation of A + C - B - 
D. 

[0025] 

Further, the image signal read method according to 
the present invention is characterized in that the signals 
A and B are disposed on a same line or on a same column, 
and the signals C and D are disposed on a same line or on 
a same column. 
[0026] 

Further, the image signal read method of reading 
an image signal from the color image pickup apparatus 
according to the present invention is characterized in that 
a difference between an addition signal of a first row, first 
column signal and a first row, second column signal and an 
addition signal of a second row, first column signal and 
a second row, second column signal, respectively in an area 
of two rows x two columns column, is read as a first color 
difference signal, and a difference between an addition 
signal of a first row, first column signal and a second row, 
first column signal and an addition signal of a first row, 
second column signal and a second row, second column signal, 
respectively in the area of two rows x two columns column, 
is read as a second color difference signal - 
[0027] 

Further, the image signal read method according to 
the present invention is characterized in that the areas 
of two rows x two columns are disposed without any space 
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therebetween . 
[0028] 

Further, the image signal read method of reading 
an image signal from the color image pickup apparatus 
according to the present invention is characterized in that 
an addition signal of all signals in an area of four rows 
x two columns is read as a luminance signal . 
[0029] 

Further, the image signal read method of reading 
an image signal from the color image pickup apparatus 
according to the present invention is characterized in that 
an addition signal of all signals in an area of two rows 
x four columns is read as a luminance signal. 
[0030] 

According to the present invention, there is 
provided a color image pickup apparatus for generating a 
color image signal from an incident light on an image pickup 
element through a color filter array of four colors, 
comprising: first calculating means for calculating a 
difference between an average signal of a first row, first 
column signal and a first row, second column signal in an 
area of two rows x two columns and an average signal of a 
second row, first column signal and a second row, second 
column signal in the area of two rows x two columns; and 
second calculating means for calculating a difference 
between an average signal of a first row, first column signal 
and a second row, first column signal in the area of two 
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rows x two columns and an average signal of a first row, 
second column signal and a second row, second column signal 
in the area of two rows x two columns. 
[0031] 

The color image pickup apparatus according to the 
present invention is characterized in that the first 
calculating means comprises first storing means for storing 
the first row, first column signal, second storing means 
for storing the first row, second column signal, third 
storing means for storing the second row, first column 
signal, fourth storing means for storing the second row, 
second column signal, first averaging means for averaging 
the signals stored in the first and second storage means, 
second averaging means for averaging the signals stored in 
the third and fourth storage means, and first difference 
calculating means for calculating a difference between an 
averaged signal of the signals stored in the first and second 
storage means and an averaged signal of the signals stored 
in the third and fourth storage means; and the second 
calculating means comprises fifth storing means for storing 
the first row, first column signal, sixth storing means for 
storing the second row, first column signal, seventh storing 
means for storing the first row, second column signal, 
eighth storing means for storing the second row, second 
column signal, third averaging means for averaging the 
signals stored in the third and fourth storage means, fourth 
averaging means for averaging the signals stored in the 



- 21 - 



fifth and sixth storage means, and second difference 
calculating means for calculating a difference between an 
averaged signal of the signals stored in the fifth and sixth 
storage means and an averaged signal of the signals stored 
in the seventh and eighth storage means. 
[0032] 

According to the present invention, there is 
provided a processing apparatus for the color image pickup 
apparatus recited above, comprising means for performing 
an operation of A + B - C - D, where A, B, C, and D represent 
signals picked up from an area of two rows x two columns. 
[0033] 

The processing apparatus according to the present 
invention is characterized in that the signals A and B are 
disposed on a same line or on a same column, and the signals 
C and D are disposed on a same line or on a same column . 
[0034] 

Further, the processing apparatus according to the 
present invention is characterized by further comprising 
means for performing an operation of A + C - B - D. 
[0035] 

Further, the processing apparatus according to the 
present invention is characterized in that the signals A 
and B are disposed on a same line or on a same column, and 
the signals C and D are disposed on a same line or on a same 
column. The processing apparatus according to the present 
invention for the color image pickup apparatus recited above 
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is characterized by comprising a step of performing an 
operation of A + B - C - D, where A, B, C, and D represent 
signals picked up from an area of two rows x two columns. 
[0036] 

Further, the processing apparatus according to the 
present invention is characterized in that the signals A 
and B are disposed on a same line or on a same column, and 
the signals C and D are disposed on a same line or on a same 
column . 
[0037] 

Further, the processing apparatus according to the 
present invention is characterized by comprising a step of 
performing an operation of A + C - B - D. 
[0038] 

Further, the processing apparatus according to the 
present invention is characterized in that the signals A 
and B are disposed on a same line or on a same column, and 
the signals C and D are disposed on a same line or on a same 
column . 
[0039] 

According to the present invention, there is 
provided a computer readable storage medium storing a 
program for the color image pickup apparatus recited above, 
wherein the program performs an operation of A + B - C - 
D, where A, B, C, and D represent signals picked up from 
an area of two rows x two columns, 
[0040] 
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Also, the storage medium according to the present 
invention is characterized in that the signals A and B are 
disposed on a same line or on a same column, and the signals 
C and D are disposed on a same line or on a same column. 
[0041] 

Further, the storage medium according to the 
present invention is characterized in that the program 
further includes a program of performing an operation of 
A + C - B - D. 
[0042] 

Further, the storage medium according to the 
present invention is characterized in that the signals A 
and B are disposed on a same line or on a same column, and 
the signals C and D are disposed on a same line or on a same 
column. 
[0043] 

According to the present invention, there is 
provided an image pickup system comprising the color image 
pickup apparatus recited above and the processing apparatus 
recited above. 
[0044] 

[Detailed Description of the Preferred Embodiments] 
(First Embodiment) 

Fig. 1 shows a pattern of color filters according 
to the first embodiment of the invention. This pattern has 
a periodicity of two pixels in the horizontal direction and 
two pixels in the vertical direction. In a pattern of two 
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pixels in the horizontal direction and two pixels in the 
vertical direction, the first row has G and Ye color filters 
disposed in this order from the left, and the second row 
has Cy and Mg color filters disposed in this order from the 
left. The pattern of color filters may be reversed right 
and left, or up and down. 
[0045] 

The luminance signal Y, blue color difference 
signal CB, and red color difference signal CR can be 
calculated respectively from the equations (2) and (3) by 
using Cy, Ye, Mg, and G signals in various color filter 
patterns. Fig. 2 shows a pattern of color filters 
constituted of a fundamental pattern of two pixels in the 
horizontal direction and two pixels in the vertical 
direction. With reference to Fig. 2, particular read 
methods will be described. 
[0046] 

1st Read Method: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl), (G2 + Ye2) , (Cy2 + Mg2 ) , 
(G3 + Ye3), (Cy3 + Mg3) , (G4 + Ye4), (Cy4 + Mg4 ) , . . . 
and the color difference signals CD being, for example: 
CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 = (G2 + Ye2) - (Cy2 + Mg2) 

CB3 = (G3 + Ye3) - (Cy3 + Mg3) 
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CB4 = (G4 + Ye4) - (Cy4 + Mg4) . 

[0047] 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Cyl), (Yel + Mgl) , (G2 + Cy2) , (Ye2 + Mg2), 
(G3 + Cy3), (Ye3 + Mg3) , (G4 + Cy4), (Ye4 + Mg4),... 
and the color difference signals CR being, for example: 

CR1 = (Gl + Cyl) - (Yel + Mgl) 

CR2 = (G2 + Cy2) - (Ye2 + Mg2) 

CR3 = (G3 + Cy3) - (Ye3 + Mg3) 

CR4 = (G4 + Cy4) - (Ye4 + Mg4). 
With the first read method, the color difference signals 
CB and CR each can be obtained from two pixels in the 
horizontal direction and two pixels in the vertical 
direction, resulting in a high resolution. 
[0048] 

2nd Read Method: 

A luminance signal Y is calculated from a series 
of signals output from image pickup elements, the series 
being : 

(Gl + Cyl + G3 + Cy3), (Yel + Mgl + Ye3 + Mg3) , 
(G2 + Cy2 + G4 + Cy4), (Ye2 + Mg2 + Ye4 + Mg4),... 
and the luminance signals Y being, for example: 

Yl = (Gl + Cyl + G3 + Cy3) + (Yel + Mgl + Ye3 + Mg3) 
Y2 = (G2 + Cy2 + G4 + Cy4 ) + (Ye2 + Mg2 + Ye4 + Mg4) . 
With the second read method, one luminance signal Ye is 



obtained for every two pixels in the horizontal direction. 
The level of the luminance signal Y is high. The luminance 
signal Y generated by this method is suitable for an 
autofocus detecting signal particularly when an object has 
a high horizontal resolution such as a fine vertical stripe 
pattern and has a low luminance. 
[0049] 

3rd Read Method: 

A luminance signal Y is calculated from a series 
of signals output from image pickup elements, the series 
being : 

(Gl + Yel + G2 + Ye2), (Cyl + Mgl + Cy2 + Mg2), 
(G3 + Ye3 + G4 + Ye4), (Cy3 + Mg3 + Cy4 + Mg4),... 
and the luminance signals Y being, for example: 

Yl = (Gl + Yel + G2 + Ye2) + (Cyl + Mgl + Cy2 + Mg2) 
Y2 = (G3 + Ye3 + G4 + Ye4) + (Cy3 + Mg3 + Cy4 + Mg4) . 
With the third read method, one luminance signal Ye is 
obtained for every two pixels in the vertical direction. 
The level of the luminance signal Y is high in the vertical 
direction. The luminance signal Y generated by this method 
is suitable for an autofocus detecting signal particularly 
when an object has a high horizontal resolution such as a 
fine horizontal stripe pattern. 
[0050] 

4th Read Method: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 



pickup elements, the series being: 

(Gl + Yel) , (Cyl + Mgl) , (G2 + Ye2) , (Cy2 + Mg2) , . . . and 
the color difference signals CB being, for example: 

CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 - (G2 + Ye2) - (Cy2 + Mg2). 

[0051] 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(G3 + Cy3), (Ye3 + Mg3) , (G4 + Cy4 ) , (Ye4 + Mg4),... 
and the color difference signals CR being, for example: 

CR1 = (G3 + Cy3) - (Ye3 + Mg3) 

CR2 = (G4 + Cy4) - (Ye4 + Mg4). 
With the fourth read method, a color difference line 
sequential signal can be obtained. The fourth read method 
is suitable for a moving image object, because the number 
of read signals is a half of the first read method. 
[0052] 

5th Read Method: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl), (G2 + Ye2), (Cy2 + Mg2),... 
and the color difference signals CB being, for example: 

CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 = (G2 + Ye2) - (Cy2 + Mg2). 

[0053] 
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Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(G2 + Cy2), (Ye2 + Mg2), (G4 + Cy4 ) , (Ye4 + Mg4),... 
and the color difference signals CR being, for example: 

CR1 - (G2 + Cy2) - (Ye2 + Mg2) 

CR2 = (G4 + Cy4) - (Ye4 + Mg4). 
The fifth read method is suitable for a moving image object. 
[0054] 

An image signal can be read at high speed because 
the number of read color difference signals of pixels is 
a half of the first read method. 
[0055] 

6th Read Method: 

Color difference signals CB are calculated by the 
method similar to the fifth read method. 
[0056] 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl, Cyl), (Yel, Mgl) , (G3,, Cy3) , (Ye3, Mg3) , . . . 
and the color difference signals CR being, for example: 

CR1 = (Gl + Cyl) - (Yel + Mgl) 

CR2 = (G3 + Cy3) - (Ye3 + Mg3) . 
The sixth read method is suitable for a moving image object. 
[0057] 

An image signal can be read at high speed because 
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the number of read color difference signals of pixels is 

a half of the first read method. 

[0058] 

7th Read Method: 

Color difference signals CB are calculated by the 
method similar to the fifth read method. 
[0059] 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl, Cyl), (Yel, Mgl) , (G2, Cy2) , (Ye2, Mg2),... 
and the color difference signals CR being, for example: 

CR1 = (Gl + Cyl) - (Yel + Mgl) 

CR2 = (G2 + Cy2) - (Ye2 + Mg2) . 
The seventh read method is suitable for a moving image 
object . 
[0060] 

An image signal can be read at high speed because 
the number of read color difference signals of pixels is 
a half of the first read method. 
[0061] 

The color difference signals CB and CR are obtained 
from the same area. 
[0062] 

8th to 11th Read Methods: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
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pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl), (G3 + Ye3) , (Cy3 + Mg3) , . . . 
and the color difference signals CB being, for example: 

CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 = (G3 + Ye3) - (Cy3 + Mg3) . 

[0063] 

The color difference signals CR are calculated by 
the similar method to the fourth to seventh read methods. 
The eighth to eleventh read methods are suitable for a moving 
image object. 
[0064] 

An image signal can be read at high speed because 
the number of read color difference signals of pixels is 
a half of the first read method. 
[0065] 

12th Read Method: 

Color difference signals CB are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(Gl + Yel), (Cyl + Mgl),... 
and the color difference signal CB being, for example: 

CB1 = (Gl + Yel) - (Cyl + Mgl) 

[0066] 

Color difference signals CR are calculated from 
adjacent pairs of a series of signals output from image 
pickup elements, the series being: 

(G4, Cy4) , (Ey4, Mg4) , . . . 



and the color difference signal CR being, for example: 
CR1 = (G4 + Cy4) - (Ye4 + Mg4) 

The twelfth method is suitable for a moving image 

object , 
[0067] 

An image signal can be read at high speed because 
the number of read color difference signals of pixels is 
a quarter of the first read method. 
[0068] 

13th Read Method: 

Luminance signals Y are calculated from adjacent 
pairs of a series of signals output from image pickup 
elements, the series being: 

(Gl + Yel), (Cyl + Mgl) , (G2 + Ye2), (Cy2 + Mg2) , 
(G3 + Ye3), (Cy3 + Mg3) , (G4 + Ye4), (Cy4 + Mg4),... 
and the luminance signals Y being, for example: 

Yl = (Gl + Yel) + (Cyl + Mgl) 

Y2 = (G2 + Ye2) + (Cy2 + Mg2) 

Y3 = (G3 + Ye3) + (Cy3 + Mg3) 

Y4 = (G4 + Ye4) + (Cy4 + Mg4). 

[0069] 

14th Read Method: 

Luminance signals Y are calculated from adjacent 

pairs of a series of signals output from image pickup 

elements, the series being: 

(Gl + Cyl), (Yel + Mgl), (G2 + Cy2), (Ye2 + Mg2), 
(G3 + Cy3), (Ye3 + Mg3) , (G4 + Cy4 ) , (Ye4 + Mg4),... 
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and the luminance signals Y being, for example: 
Yl = (Gl + Cyl) + (Yel + Mgl) 
Y2 = (G2 + Cy2) + (Ye2 + Mg2) 
Y3 = (G3 + Cy3) + (Ye3 + Mg3) 
Y4 = (G4 + Cy4) + (Ye4 + Mg4). 

[0070] 

The above read methods may be used while pixels are 
read by thinning them in the unit of a fundamental pattern 
or a plurality of fundamental pattern to thereby speed up 
a read operation . 
[0071] 

( Second Embodiment ) 

Next, a circuit structure realizing the read method 
of the first embodiment using CMOS sensors as an example 
of image pickup elements will be described. 
[0072] 

Fig. 3 is a circuit diagram showing the structure 
of a CMOS sensor of the second embodiment. In this 
embodiment, the CMOS sensor includes: a first output series 
for outputting a difference between an average value of 
detection light amounts of two photo detecting elements 
adjacent in the vertical direction in one column and an 
average value of detection light amounts of two photo 
detecting elements adjacent in the vertical direction in 
the next column; and a second output series for outputting 
a difference between an average value of detection light 
amounts of two photo detecting elements adjacent in the 
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horizontal direction in one row and an average value of 
detection light amounts of two pixels adjacent in the 
horizontal direction in the next row. Therefore, the CMOS 
sensor of this embodiment can use the first read method. 
[0073] 

Referring to Fig. 3, reference numeral 1 represents 
a vertical scan circuit for generating an enable signal 
which enables a control signal of each row, the enable signal 
sequentially becoming active in the vertical direction. 
Reference numeral 100 represents a photodiode serving as 
a photodetector for converting incidence light into 
electric charges. Reference numeral 101 represents a 
transfer transistor for transferring the electric charges 
generated by the photodiode 100 to a floating diffusion 
region 102 which temporarily stores the transferred 
electric charges. Reference numeral 103 represents a reset 
transistor for discharging electric charges accumulated in 
the gate of an amplifier transistor 104. Reference numeral 
121 represents a switching transistor. Reference numeral 
112 represents a constant current source transistor which 
is activated by a voltage applied to a terminal 7 . Reference 
numeral 105 represents a transistor for discharging 
electric charges in capacitors 109, 110, 117, and 118. 
Reference numeral 106 represents a current distribution 
division transistor for connecting the source of the 
transistor 104 to the capacitor 109. Reference numeral 107 
represents a current distribution transistor for connecting 
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the source of the transistor 104 to the capacitor 110. The 
capacitors 109 and 110 function as a line memory which is 
charged by a voltage supplied from the transistor 104. 
Reference numeral 108 represents an averaging transistor 
for averaging the electric charges in the capacitors 109 
and 110. Reference numeral 111 represents a switching 
transistor for applying a voltage of the line memory 109 
to a buffer 123 at the front stage of a differential amplifier 
122 which amplifies a difference between voltages across 
the capacitors 109 and 109 Reference numeral 113 
represents a switching transistor for connecting the source 
of the transistor 104 to a capacitor 117. Reference numeral 

114 represents a switching transistor for connecting the 
source of the transistor 104 to a capacitor 118. The 
capacitors 117 and 118 are charged by a current supplied 
from the source of the transistor 104. Reference numeral 

115 represents a switching transistor for controlling to 
average the electric charges stored in the capacitors 117 
and 117*. Reference numeral 116 represents a switching 
transistor for controlling to average the electric charges 
stored in the capacitors 118 and 118 Reference numeral 
119 represents a switching transistor for supplying a 
voltage of the line memory 117 to a buffer 129 at the front 
stage of a differential amplifier 127 which amplifies a 
difference between voltages across the capacitors 117 and 
118 1 . The constant current source transistor 112 is 
activated in the unit of a row, and paired with the transistor 
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104 to constitute an amplifier. 
[0074] 

Fig. 4 is a timing chart illustrating an operation 
of the CMOS sensor shown in Fig. 3. With reference to Figs. 
3 and 4, the operation of the CMOS sensor shown in Fig. 3 
will be described. 
[0075] 

At timing T201, a pulse applied to a terminal 11 
takes a high state, and pulses applied to M terminals 30, 
31, 50, and 51 take the high state. Therefore, the line 
memories 109, 110, 117, and 118 are reset to initial 
potentials. At the same time, a start pulse applied to a 
terminal 2 of the vertical scan circuit 1 and a scan pulse 
applied to a terminal 3 take the high level, so that the 
vertical scan circuit 1 starts scanning to select the first 
row. A high level pulse is applied to a terminal 8 to reset 
the floating diffusion regions of the pixel area. At timing 
T202, a reset pulse at the terminal 8 falls so that the 
floating diffusion regions of first row pixels are made in 
an electrically floating state. At timing T203, a high 
level pulse is applied to a terminal 9 so that electric 
charges are transferred from photodiodes of the first row 
to the floating diffusion regions. At timing T204, a high 
level pulse is applied to terminals 10, 30, and 50 so that 
a voltage proportional to light amounts detected with the 
photodetectors of the first row is read to the capacitors 
109 and 117 via the amplifier 104. At timing T205, the 
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vertical scan pulse 3 falls. At timing T206, the vertical 
scan pulse 3 again rises to select the second row. At timing 
T207, a reset pulse false so that the floating diffusion 
regions of pixels of the second row are made in an 
electrically floating state. At timing T208, similar to 
timing T203, a high level pulse is applied to the terminal 
9 so that electric charges are transferred from photodiodes 
of the second row to the floating diffusion regions. At 
timing T209, similar to timing T204, a high level pulse is 
applied to terminals 10, 30, and 51 so that a voltage 
proportional to light amounts detected with the 
photodetectors of the second row is read to the capacitors 
110 and 118 via the amplifier 104 of the second row. At 
timing T210, a high level pulse is applied to terminals 40, 
60, and 61 to average the electric charges on the line 
memories. At timing T211, a horizontal scan circuit 4 
starts scanning so that averaged voltages are seguentially 
applied in the horizontal direction to the differential 
amplifiers 122 and 127 . The differential amplifiers 122 and 
127 outputs a blue color difference signal CB and a red color 
difference signal CR. By connecting adders (not shown) made 
of an operational amplifier or the like to the terminals 
70 and 71 and to the terminals 80 and 81, luminance signals 
can be output. 
[0076] 

If the averaging operation by the averaging 
transistor 108 is not performed and the signals of all rows 
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are temporarily stored in the capacitor 109, an output 
signal of each pixel in the odd column can be obtained from 
the output terminal 71, and an output signal of each pixel 
in the even column can be obtained from the output terminal 
70. 

[0077] 

(Third Embodiment) 

Fig. 5 is a circuit diagram showing the structure 
of a CMOS sensor of the third embodiment . In this embodiment, 
the CMOS sensor includes an output series for outputting 
an average value of detection light amounts of two photo 
detecting elements adjacent in the horizontal direction or 
an average of detection light amounts of four photo 
detecting elements adjacent in the horizontal direction. 
Therefore, the CMOS sensor of this embodiment can use the 
third read method by summing the two outputs of the CMOS 
sensor . 
[0078] 

In Fig. 7, like elements to those similar to the 
CMOS sensor of the second embodiment are represented by 
using identical reference numerals, and the duplicated 
description thereof is omitted. Reference numeral 301 
represents a switching transistor for controlling to 
average electric charges accumulated in capacitors 109 and 
109'. Reference numeral 302 represents a switching 
transistor for controlling to average electric charges 
accumulated in capacitors 110 and 110' . Reference numeral 
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301 1 represents a switching transistor for controlling to 
average electric charges accumulated in capacitors 109" and 
109"'. Reference numeral 302' represents a switching 
transistor for controlling to average electric charges 
accumulated in capacitors 110" and 110"'. Reference 
numeral 303 represents a switching transistor for 
controlling to average electric charges accumulated in the 
capacitors 109 1 and 109". Reference numeral 304 represents 
a switching transistor for controlling to average electric 
charges accumulated in the capacitors 110 ' and 110" . If the 
switching transistors 301, 301', and 303 are operated 
synchronously, the electric charges stored in the 
capacitors 109, 109', 109", and 109" 1 are averaged. For 
example, if after or when the switching transistors 301 and 
301 1 are turned on, the switching transistor 303 is turned 
on, these transistors average the electric charges stored 
in the capacitors 109, 109', 109", and 109"'. If the 
switching transistors 302, 302', and 304 are operated 
synchronously, these transistors average the electric 
charges stored in the capacitors 110, 110', 110", and 110" 1 . 
Namely, if after or when the switching transistors 302 and 
304* are turned on, the switching transistor 304 is turned 
on, these transistors average the electric charges stored 
in the capacitors 110, 110', 110", and 110"'. 
[0079] 

Fig. 6 is a timing chart illustrating an operation 
of the CMOS sensor shown in Fig. 5. With reference to Figs. 
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5 and 6, the operation of the CMOS sensor shown in Fig, 5 

will be described. 

[0080] 

At timing T401, a start pulse applied to a terminal 
2 of the vertical scan circuit 1 and a scan pulse applied 
to a terminal 3 take the high level, so that the vertical 
scan circuit 1 starts scanning to select the first row. A 
high level pulse is applied to a terminal 8 to reset the 
floating diffusion regions of the pixel area. At timing 
T402, a reset pulse at the terminal 8 falls so that the 
floating diffusion regions of first row pixels are made in 
an electrically floating state. At timing T403, a high 
level pulse is applied to a terminal 9 so that electric 
charges in the photodetectors of the first row are 
transferred to the floating diffusion regions. At timing 
T404, a high level pulse is applied to terminals 10 and 50 
so that a voltage proportional to light amounts detected 
with the photodetectors of the first row is read to the 
capacitor 109 via the amplifier 104. At timing T405, the 
vertical scan pulse 3 rises. At timing T406, the vertical 
scan pulse 3 again falls to select the second row. At timing 
T407, a reset pulse false so that the floating diffusion 
regions of pixels of the second row are made in an 
electrically floating state. At timing T408, similar to 
timing T403, a high level pulse is applied to the terminal 
9 so that electric charges are transferred from photodiodes 
of the second row to the floating diffusion regions. At 
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timing T409, similar to timing T404, a high level pulse is 
applied to terminals 10, and 51 so that a voltage 
proportional to light amounts detected with the 
photodetectors of the second row is read to the capacitor 
110 via the amplifier 104 of the second row. At timing T410, 
a high level pulse is applied to terminals 60, 61, 90, and 
91 to average the electric charges in the capacitors 109, 
109', 109", and 109" 1 on the line memories and to average 
the electric charges in the capacitors 110, 110 110", and 
110"' on the line memories. At timing T411, a horizontal 
scan circuit 4 starts scanning so that averaged voltages 
are sequentially output in the horizontal direction. Since 
a luminance signal is output in this embodiment, only one 
output terminal 16 is used. If a plurality of output 
terminals like those shown in Fig. 5 are used, color 
difference signals can be obtained. 
[0081] 

( Fourth Embodiment ) 

Fig. 7 is a circuit diagram showing the structure 
of a CMOS sensor of the fourth embodiment. In this 
embodiment, the CMOS sensor includes an output series for 
outputting an average value of detection light amounts of 
two photo detecting elements adjacent in the vertical 
direction or an average of detection light amounts of four 
photo detecting elements adjacent in the vertical direction. 
Therefore, the CMOS sensor of this embodiment can use the 
second read method by summing the two outputs of the CMOS 
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sensor . 
[0082] 

In Fig. 7, like elements to those similar to the 
CMOS sensor of the third embodiment are represented by using 
identical reference numerals, and the duplicated 
description thereof is omitted. Reference numerals 501, 
502, 503, and 504 represent current distribution 
transistors for distributing current supplied from a 
transistor to capacitors 508, 109, 510, and 511. The 
capacitor 508 stores signals from first row photodetectors, 
the capacitor 509 stores signals from second row 
photodetectors, the capacitor 510 stores signals from third 
row photodetectors, and the capacitor 511 stores signals 
from fourth row photodetectors. Reference numeral 505 
represents a switching transistor for controlling to 
average electric charges accumulated in the capacitors 508 
and 509. Reference numeral 506 represents a switching 
transistor for controlling to average electric charges 
accumulated in the capacitors 509 and 510. Reference 
numeral 507 represents a switching transistor for 
controlling to average electric charges accumulated in the 
capacitors 510 and 511. If the switching transistors 505, 
506, and 507 are operated synchronously, the electric 
charges stored in the capacitors 508, 509, 510, and 511 are 
averaged. For example, if after or when the switching 
transistors 505 and 507 are turned on, the switching 
transistor 506 is turned on, these transistors average the 
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electric charges stored in the capacitors 508, 509, 610, 

and 511. 

[0083] 

Fig. 8 is a timing chart illustrating an operation 
of the CMOS sensor shown in Fig. 7. With reference to Figs. 
7 and 8, the operation of the CMOS sensor shown in Fig. 7 
will be described. 
[0084] 

At timing T601, a start pulse applied to a terminal 
2 of the vertical scan circuit 1 and a scan pulse applied 
to a terminal 3 take the high level, so that the vertical 
scan circuit 1 starts scanning to select the first row. A 
high level pulse is applied to a terminal 8 to reset the 
floating diffusion regions of the pixel area. At timing 
T602, a reset pulse at the terminal 8 falls so that the 
floating diffusion regions of first row pixels are made in 
an electrically floating state. At timing T603, a high 
level pulse is applied to a terminal 9 so that electric 
charges in the photodetectors of the first row are 
transferred to the floating diffusion regions. At timing 
T604, a high level pulse is applied to terminals 10 and 30 
so that a voltage proportional to light amounts detected 
with the photodetectors of the first row is read to the 
capacitor 508. At timing T605, the vertical scan pulse 3 
rises . At timing T606, the vertical scan pulse 3 again rises 
to select the second row. At timing T607, a reset pulse 
falls so that the floating diffusion regions of pixels of 
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the second row are made in an electrically floating state. 
At timing T608, similar to timing T603, a high level pulse 
is applied to the terminal 9 so that electric charges are 
transferred from photodiodes of the second row to the 
floating diffusion regions. At timing T609, similar to 
timing T604, a high level pulse is applied to terminals 10, 
and 31 so that a voltage proportional to light amounts 
detected with the photodetectors of the second row is read 
to the capacitor 509. Similarly at timing T610, a high level 
pulse is applied to terminals 10 and 32 so that a voltage 
proportional to light amounts detected with the 
photodetectors of the third row is read to the capacitor 

510 . Similarly at timing T611, a high level pulse is applied 
to terminals 10 and 33 so that a voltage proportional to 
light amounts detected with the photodetectors of the fourth 
row is read to the capacitor 511. At timing T612, a high 
level pulse is applied to the terminals 40 and 41 to average 
the electric charges in the capacitors 508, 509, 510, and 

511 on the line memories. At timing T613, a horizontal scan 
circuit 4 starts scanning so that averaged voltages are 
sequentially output in the horizontal direction. Voltages 
proportional to average values of light amounts detected 
with the photodetectors of the first to fourth rows are 
sequentially output from an output terminal 70. 

[0085] 

If the averaging operation by the switching 
transistor 506 is not performed, an average value of the 
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first and second columns may be output from the output 
terminal 70 and an average value of the third and fourth 
columns may be output from an output terminal 71. A 
difference between the average value of the first and second 
columns and the average value of the third and fourth columns 
may be output from an output terminal 72. 
[0086] 

In the operation described with reference to Figs. 
3 to 8, a reset voltage at the floating diffusion regions 
may be read to another line memory, prior to reading image 
signals of pixels. In this case, by using a difference 
between the reset voltage and the image signal, a variation 
of output voltages to be caused by a variation of threshold 
voltages of transistors 104 can be eliminated. Therefore, 
an image signal with a high S/N ratio can be obtained which 
does not contain noise components to be generated by a 
variation of image signals caused by a variation of amounts 
of light detected with photodetectors . 
[0087] 

Vertical/horizontal scanning may be performed by 
thinning pixels in the unit of one block or a plurality of 
blocks so that more compressed image signals can be 
obtained. 
[0088] 

Other photoelectric conversion elements may be used 
to obtain similar advantages of the above embodiments. 
[0089] 
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In the above embodiments, color filters of four 
colors including yellow Ye, magenta Mg, cyan Cy, and green 
G are used. Other color filters may also be used if they 
can obtain a luminance signal and color difference signals. 
[0090] 

(Fifth Embodiment) 

Fig. 9 is a block diagram showing the structure of 
an image pickup system with an image pickup apparatus, 
according to the fifth embodiment of the invention. 

[0091] 

Referring to Fig. 9, signals from pixels of an image 
pickup apparatus 91 such as a CMOS sensor are supplied 
directly to an A/D converter 92, without processing the 
signals such as addition calculation to obtain color 
difference signals and a luminance signal. After the 
signals are converted by the A/D converter 92 into digital 
signals, they are stored in a memory 93. A computer 94 
performs necessary calculations for digital signals stored 
in the memory 93 to obtain a luminance signal and color 
difference signals. Software for running the computer 94 
may be stored in a storage medium storing programs. The 
storage medium storing such programs may be a floppy disk, 
a hard disk, an optical disk, a magneto-optical disk, a 
CD-ROM, a magnetic tape, a semiconductor memory, and a like. 
[0092] 

[Effect of the Invention] 

As described so far, according to the present 



- 46 - 



invention, a color image signal with color difference 
signals having a high resolution both in the horizontal and 
vertical directions can be obtained, for example by using 
the first read method. 
[0093] 

According to the embodiments, there are various 
read modes relative to the same color filer pattern. 
Accordingly, the embodiments can be applied to a multi- 
mode such as a mode of outputting an image signal at high 
speed which signal can be used for simple color display, 
autofocus, white balance adjustment and a mode of outputting 
an image signal having a high resolution. 
[Brief Description of the Drawings] 

[Figure 1] 

A diagram showing a pattern of color filters 
according to the first embodiment of the invention. 
[Figure 2] 

A diagram illustrating a read method according to 
the first embodiment of the invention. 
[Figure 3] 

A circuit diagram of an image pickup apparatus 
according to the second embodiment of the invention . 
[Figure 4] 

A timing chart illustrating the operation of the 
image pickup apparatus shown in Fig. 3. 
[Figure 5] 

A circuit diagram of an image pickup apparatus 
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according to the third embodiment of the invention. 
[Figure 6] 

A timing chart illustrating the operation of the 
image pickup apparatus shown in Fig. 5. 
[Figure 7] 

A circuit diagram of an image pickup apparatus 
according to the fourth embodiment of the invention. 
[Figure 8] 

A timing chart illustrating the operation of the 
image pickup apparatus shown in Fig. 7. 
[Figure 9] 

A diagram showing an image pickup system with an 
image pickup apparatus, according to the fifth embodiment 
of the invention. 

[Figure 10] 

A diagram showing a pattern of conventional color 

filters . 

[Figure 11] 

A diagram showing another pattern of conventional 
color filters. 

[Description of Reference Numerals or Symbols] 

100 ... photodetector 

101 ... transfer transistor 

102 ... floating diffusion region 

103 ... reset transistor 

104 ... amplifier transistor 

106, 107, 501, 502, 503, 504 ...current distribution 
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transistors 

121 ... switching transistor 
105 ... discharging transistor 

108, 115, 116, 301, 302, 303, 304, 505, 506, 507 
... averaging transistors 

109, 110, 117, 118 ... capacitors (line memories) 
122, 127 ... differential amplifiers 
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